Method and apparatus for virtual editing of multimedia presentations

ABSTRACT

A method and apparatus for viewing desired portions of a multimedia presentation. Desired portions of a multimedia presentation are determined. In one embodiment, an editor may determine which portions of the presentation are desired. Alternatively, or additionally, specified criteria may be applied to the presentation to determine the desired portions. An annotation file is then created based upon the determined desired portions of the multimedia presentation. The annotation file contains pointers corresponding to the desired portions of the multimedia presentation. Annotation management software may be use the annotation file to cause a display device to display only desired portions of the presentation. The annotation file may be applied to a broadcast presentation or a recorded program file. In one embodiment the annotation file may contain information related to the desired portions of the multimedia presentation and/or the remainder of the multimedia presentation.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of and claims the benefit of priorityfrom co-pending non-provisional U.S. application Ser. No. 09/997,713,filed Nov. 29, 2001 and entitled “Method and Apparatus for VirtualEditing of Multimedia Presentations,” which is related to, and claimsthe benefit of priority of provisional U.S. application Ser. No.60/250,978 filed Dec. 1, 2000. Both applications are hereby incorporatedby reference in their entirety.

FIELD OF THE INVENTION

This invention relates generally to multimedia presentations and morespecifically to methods and apparatuses for virtually editing the same.

BACKGROUND OF THE INVENTION

In most multimedia presentations available today there is at least somecontent that a viewer would prefer was not presented. A viewer may wishto avoid certain portions of a presentation for many reasons. Forexample, a viewer may wish to avoid portions of a movie containingviolence or profanity. A viewer may wish to avoid presentation ofpolitically or religiously objectionable portions of a news broadcast,or socially objectionable portions of a music video, for example. Or aviewer may simply wish to avoid portions of a multimedia presentationthat are boring or uninteresting to the viewer. For example, manyviewers of broadcast sporting events, such as football and baseballgames, don't have time to watch the entire event at the exact time it isbroadcast. In such cases, the viewer may wish to save time by viewingonly the portions of interest in a broadcast, (i.e., action highlights,such as home run being hit or a football scoring drive or a brilliantdefensive play).

Currently viewers have no way of separating such interesting portions ofa presentation from the presentation without first viewing the completepresentation. In the case of sporting events, viewers may rely on sportssummary shows for highlight replays, where a broadcaster edits thesports event and typically shows only a few seconds of each actionsequence. Such edited presentation are often not sufficient to fullyenjoy and appreciate the action of the event. In the case of themultimedia presentations, for example, news programs, concerts, etc.,viewers may have no way of viewing only specified portions of apresentation.

Viewers may record multimedia presentations such as sporting events,news reports, concerts, or other programs in their entirely forpresentation at a later time. While this allows viewers to avoidunwanted portions of a presentation, the viewer must also work through,at the least fast-forwarding through, all the uninteresting portions ofthe presentation.

SUMMARY OF THE INVENTION

A method and apparatus for viewing desired portions of a multimediapresentation is disclosed. Desired portions of a multimedia presentationare determined. An annotation file is then on file contains pointerscorresponding to the desired portions of the multimedia presentation.When the multimedia presentation is viewing, the annotation file may beused to cause a viewing device to present only the desired portions ofthe multimedia presentation.

Other features and advantages of the present invention will be apparentfrom the accompanying drawings, and from the detailed description, thatfollows below.

BRIEF DESCRIPTION OF THE DRAWING

The present invention is illustrated by way of example, and notlimitation, by the figures of the accompanying drawings in which likereferences indicate similar elements and in which:

FIG. 1 is a process flow diagram in accordance with one embodiment ofthe presentation invention;

FIG. 2 is a system block diagram of a broadcast system in accordancewith one embodiment of the presentation; and

FIG. 3 illustrates an exemplary recorded program file and acorresponding annotation file in accordance with one embodiment of thepresent invention.

DETAILED DESCRIPTION

An embodiment of the method of the present invention allows a viewer ofa multimedia presentation to view only desired portions of apresentation and to avoid undesired portions. In one embodiment anannotation file is created containing identification pointers thatidentify desired portion of a presentation. Annotation managementsoftware may use the identification pointers to cause a display deviceto display only desired portions of the presentation.

In the following detailed description of the present invention, numerousspecific details are set forth in order to provide a thoroughunderstanding of the present invention. However, it will be apparent toone skilled in the art that the present invention may be practicedwithout these specific details. In some instances, well-known structuresand devices are shown in block diagram form, rather than in detail, inorder to avoid obscuring the present invention.

FIG. 1 is a process flow diagram in accordance with one embodiment ofthe present invention. The process 100, shown in FIG. 1, begins withoperation 105 in which a recorded program file of a presentation iscreated. A recorded program file may be created for any type ofmultimedia presentation or may be created from a live event such as abroadcast football game. A recorded program file may be created on aviewer's set-top box and stored on the set-top box hard drive.

At operation 110 desired portions of the presentation are specified. Thespecification operation may be effected in any number of ways and basedupon many different criterion and combinations thereof. For example, aneditor may view an hours long sporting event and may personallydetermine the most interesting 15 minutes of the presentation.Alternatively, or in addition, predetermined criteria may be applied.For example, a routine determination that any unrelated aspects of asports presentation, such as intermission entertainment, are not desiredmay be implemented. The specification of desired portions may be madebased upon individual preferences provided by the viewer. For example, aviewer may determine that only portions of a news program relating tointernational events are desired. Many different parameters may be usedby themselves or in combination to allow such specification. This mayinclude but is not limited to cities, clubs, sports genres, closedcaption, activities, score indications, audio recognition, videorecognition, text, Internet data, other interactive television data,etc.

In one embodiment the specification operation for a given presentationmay be accomplished by a person deemed knowledgeable in the area towhich the presentation pertains. For example, a sport star may specifythe desired portions of a sports presentation.

At operation 115 an annotation file is created with pointers setcorresponding to the specified portions of the presentation. Thepointers may be implemented as pairs to indicate a desired portion ofthe presentation. The annotation file may contain additional informationsuch as a header to identify the program file or presentation to whichthe annotation file pertains.

In one embodiment, the annotation file may also contain informationabout the specified portions of the presentation or the remainingportions of the presentation. For example, the annotation file maypresent information indicating the time length of unspecified portionsor a synopsis of the unspecified portions. Alternatively, or inaddition, the annotation file may present information describing aspecified portion prior to the specified portion being displayed. Forexample, if the specified portion of a baseball game includes a batterhitting a home run, the annotation file may provide the viewer with suchinformation as the batter's name, the inning, the number of outs, thescore, and the batter's previous performance (e.g., two strike outswhich may have occurred in non-specified portions of the presentation).Such information may be presented prior to, or concurrent with, thespecified portion of the presentation. In some cases, this may alsoinclude multiple parallel events, recorded at approximately the sametime.

At operation 120 the annotation file and the recorded program file arethen accessed by a display device so that only the specified portions ofthe presentation are displayed. For example, the viewer's set-top boxmay contain software that controls how the recorded program file ispresented. Alternatively, the viewer may subscribe to a service thatcontrols the viewer's display device in real time.

The operation of creating an annotation file and/or the operation ofaccessing the annotation file and the recorded program file inaccordance with the present invention may be implemented by hardwareand/or software contained within the viewer's set-top box. For example,a set-top box may include one or more processors that can execute codeor instructions stored within a machine-readable medium that may also beincluded within the set-top box.

The machine-readable medium may include a mechanism that provides (i.e.,stores and/or transmits) information in a form readable by a machinesuch as computer or digital processing device. For example, amachine-readable medium may include a read only memory (ROM), randomaccess memory (RAM), magnetic disk storage media, optical storage media,flash memory devices. The code or instructions may be represented bycarrier-wave signals, infrared signals, digital signals, and by otherlike signals.

Annotation files may be available separately from the presentations towhich they pertain. For example, a viewer may obtain a DVD video movieand subsequently create or purchase an annotation file pertaining to themovie. An individual viewer may complete some or all of thespecification operation. For example, a viewer may determine that onlynon-violent portions of the movie are desired. The viewer may thencreate an annotation file that specifies only non-violent portions ofthe movie.

An annotation file, in accordance with one embodiment of the presentinvention, may be produced by the broadcaster of the multimediapresentation. Annotation files may be broadcast or e-mailed to theviewer in real time or after the presentation. Annotation files may becreated as an event is being broadcast. For example a sportscaster couldpush a button when he judges that the sporting event he is broadcastinghas become interesting and release the button when the interestingportion is complete. The sportscaster's actions could then be convertedinto software pointers of an annotation file. The annotation file couldbe used to affect the broadcast in real time or used by a viewersubsequently.

FIG. 2 describes in detail how an embodiment of the present inventionmay be applied to a broadcast presentation. However, as noted above theinvention is not restricted to broadcast events and may be applied to amultimedia presentation of any format. FIG. 2 is a system block diagramof a broadcast system in accordance with one embodiment of the presentinvention. Those skilled in the art will recognize that the invention isnot limited to embodiments illustrated by FIG. 2. For example, thesatellite broadcast system may be replaced with any of variousterrestrial broadcast systems, including but not limited to systems suchas analog or digital cable, digital subscriber line (DSL), aerial,wireless cable, fiber, local multi-channel distribution systems (LMDS),etc., all of which are well-known in the art.

The broadcast system 200, shown in FIG. 2, includes a head end 201having a satellite dish 202. Head end 201 transmits a presentation via asignal 221 from satellite dish 202 to satellite 203. Satellite 203transmits the presentation via a signal 222 to a viewer's satellitereceiver dish 210, which is connected to a set-top box 211.

Set-top box 211 contains a hard disk 212 that the viewer may use torecord the presentation as a recorded program file. The set-top box 211also contains annotation management software 214 in accordance with thepresent invention.

The viewer may typically view on a television 213 a live event or arecorded event played from hard disk 212 through set-top box 211. Theset-top box 211 may also have a back-channel connection, for example,via satellite, cable network, or public switched telephone network(PSTN) 230, through telephone connection 223, typically sharing theviewer's home phone.

The back-channel connection may also be established through connection225 to a server 243, which may, for example, receive the same broadcastas the viewer via a satellite dish 240 and a set-top box 241. Thebroadcast presentation may be recorded on a hard disk 244 connected toserver 243. A workstation 242, connected to the server 243, may be usedby an editor, not shown, to view the broadcast. The editor may thenspecify desired portions of the presentation and create an annotationfile including pointers corresponding to the desired portions of thepresentation.

The annotation file may then be downloaded from the server 243, througha back-channel connection, to Set-top box 211.

In one embodiment, the program provider or broadcaster may operateserver 243. In such cases, a link 226 may allow a direct connection viaa LAN between server 243 and head end 201. The annotation happens inserver 243 under use of workstation 242. In one embodiment theannotation file may then be transmitted back over link 226 and broadcastover a data broadcast facility, for example, embedded in an MPEG file.In an alternative embodiment, the annotation file may be transmitted viaseparate dedicated data channels, to be received by set-top box 211. Forexample, the annotation file may be sent via link 225 and PSTN,Internet, or other transmission links to set-top box 211.

In an alternative embodiment, the server 243 is operated independently.Presentations may be received using satellite 203 and link 224, andannotated in server 243, by workstation 242. The annotation file maythen be sent via link 225 and PSTN, Internet, or other transmission linkto set-top box 211. In one embodiment, the annotation content may besent over link 226, and broadcast over a data broadcast facility, forexample, embedded in an MPEG file. In an alternative embodiment theannotation file may be transmitted via separate dedicated data channels,to be received by set-top box 211 under a separate data broadcastagreement.

FIG. 3 illustrates an exemplary recorded program file and acorresponding annotation file in accordance with one embodiment of thepresent invention. The recorded program file 300, shown in FIG. 3, maybe, for example, an MPEG2 file. Alternatively, recorded program file 300may be in any type of video or audio recording file format known in theart. Portions of recorded program file 300, 300 a and 300 b, indicatedesired portions of a presentation. The corresponding annotation file310, shown in FIG. 3, includes a series of pointers, 311 a through 31In, which correspond to desired portions of a presentation in programfile 300. Some of the pointers may be paired pointers, such as 311 a and311 b, that can mark a spot and scope of a segment of interest, as dosimilarly paired pointers 311 c and 311 d and other similar pairs. Asingle pointer 311 n points to a specific singularity or event, forexample, the beginning of a particular activity.

In one embodiment, annotation file 310 may include an ID header 312 thatallows the annotation file to identify the recorded program file towhich it pertains.

When the viewer plays the annotation file and recorded program file, theannotation management software 214 reads the annotation file and causesa display device to display only the desired portions of the multimediapresentation (i.e., portions 300 a and portion 300 b of program file300). Portions of program file 300 not specified as desired are notpresented. For example, the annotation management software may cause adisplay device to skip the unspecified portions of program file 300.Therefore, the viewer may be presented only the portions determined bythe annotation file. A user interface (not shown) may also be included.The user interface may use dedicated or programmable buttons tonavigate. In one embodiment, the user interface may be controlled by,and or viewed on, a computer or internet appliance using standardPC-type controls. Furthermore, commands may be displayed on the screenand called upon with pointer devices or navigational keys. In analternative embodiment, the whole event is recorded and other scenes maybe viewed by using normal recorded media navigation, rather than specialkeys. The same are used within the selected scenes. This also appliesfor cases of partial recordings.

Many variations may be made without departing from the spirit of theinvention, which allows viewers to view only desired portions of apresentation. Annotation files specifying desired portions of multimediapresentations may be offered as a subscription service separately fromthe actual programming or the annotation files may be combined with theprogramming as an enhancement of the broadcasting service.Alternatively, annotation files may be created by individual viewers orindependent producers.

In the foregoing specification, the invention has been described withreference to specific exemplary embodiments thereof. It will, however,be evident that various modifications and changes may be made theretowithout departing from the broader spirit and scope of the invention asset forth in the appended claims. The specification and drawings are,accordingly, to be regarded in an illustrative sense rather than arestrictive sense.

What is claimed is:
 1. A method comprising: identifying a plurality ofdesired portions of a content item; automatically creating, by acomputing device having at least one processor, annotations for thecontent item, wherein automatically creating the annotations includes:storing a first identifier corresponding to a first desired portion ofthe plurality of desired portions and a second identifier correspondingto a second desired portion of the plurality of desired portions in theannotations, wherein the first desired portion and the second desiredportion are separated in the content item by an intervening portion, andstoring displayable content information describing a non-identifiedportion of the content item; and generating, by the computing device, adisplay of the displayable content information describing thenon-identified portion of the content item without displaying thenon-identified portion.
 2. The method of claim 1 further comprising:creating a recorded program file of the content item; playing thecontent item using a viewing system; and accessing the annotations suchthat, of the content item, only the plurality of desired portions aredisplayed by the viewing system.
 3. The method of claim 1, wherein theidentification of the plurality of desired portions includes applying aset of criteria to the content item.
 4. The method of claim 1, whereinthe set of criteria includes at least one preference of a viewer.
 5. Themethod of claim 1, wherein the annotations are stored in an annotationfile, the annotation file further storing: information related to theplurality of desired portions of the multimedia presentation.
 6. Amethod comprising: transmitting, by a computing device having at leastone processor, a content item to a first location; identifying aplurality of desired portions of the content item at a location remotefrom said first location; creating one or more annotations for thecontent item, the one or more annotations including a pointercorresponding to a desired portion of the plurality of desired portionsand displayable content information describing a non-identified portionof the content item, wherein the displayable content information isdifferent from the content item; and transmitting, from the locationremote from said first location, the one or more annotations to anotherdevice, including the pointer and the displayable content information,wherein the one or more annotations are configured to cause the otherdevice to generate a display of the displayable content informationalong with one or more of the plurality of desired portions.
 7. Themethod of claim 6, wherein the one or more annotations are transmittedsubsequent to content item being provided at a specified time.
 8. Themethod of claim 6, wherein creating the one or more annotations isperformed by applying a set of one or more criteria to portions of thecontent item.
 9. The method of claim 8, wherein the set of one or morecriteria is user-defined.
 10. The method of claim 6, wherein the one ormore annotations include a pair of pointers, one pointer identifying abeginning of the desired portion and the other pointer identifying anend of the desired portion.
 11. An apparatus comprising: a processor;and non-transitory memory storing computer readable instructions that,when executed, cause the apparatus to: identify a plurality of desiredportions of a content item; create annotations for the content item,wherein automatically creating the annotations includes: storing a firstidentifier corresponding to a first desired portion of the plurality ofdesired portions and a second identifier corresponding to a seconddesired portion of the plurality of desired portions in the annotations,wherein the first desired portion and the second desired portion areseparated in the content item by an intervening portion, and storingdisplayable content information describing a non-identified portion ofthe content item; and generate a display of the displayable contentinformation describing the non-identified portion of the content itemwithout displaying the non-identified portion.
 12. The apparatus ofclaim 11, wherein the computer readable instructions, when executed,further cause the apparatus to: create a recorded program file of thecontent item; render the content item using a viewing system; and accessthe annotations such that, of the content item, only the plurality ofdesired portions are displayed by the viewing system.
 13. The apparatusof claim 11, wherein the identification of the plurality of desiredportions includes applying a set of criteria to the content item. 14.The apparatus of claim 11, wherein the set of criteria includes at leastone preference of a viewer.
 15. The apparatus of claim 11, wherein theannotations are stored in an annotation file, the annotation filefurther storing: information related to the plurality of desiredportions of the multimedia presentation.
 16. The apparatus of claim 11,wherein the apparatus is a set-top box.
 17. An apparatus comprising: aprocessor; and non-transitory memory storing computer readableinstructions that, when executed, cause the apparatus to: transmit acontent item to a first location; identify a plurality of desiredportions of the content item at a location remote from said firstlocation; create one or more annotations for the content item, the oneor more annotations including a pointer corresponding to a desiredportion of the plurality of desired portions and displayable contentinformation describing a non-identified portion of the content item,wherein the displayable content information is different from thecontent item; and transmit, from the location remote from said firstlocation, the one or more annotations to another device, including thepointer and the displayable content information, wherein the one or moreannotations are configured to cause the other device to generate adisplay of the displayable content information along with one or more ofthe plurality of desired portions.
 18. The apparatus of claim 17,wherein the one or more annotations are transmitted subsequent to thecontent item being provided at a specified time.
 19. The apparatus ofclaim 17, wherein creating the one or more annotations is performed byapplying a set of one or more criteria to portions of the content item.20. The apparatus of claim 19, wherein the set of one or more criteriais user-defined.
 21. The apparatus of claim 17, wherein the one or moreannotations include a pair of pointers, one pointer identifying abeginning of the desired portion and the other pointer identifying anend of the desired portion.